L2 regularization

A type of regularization that penalizes weights in proportion to the sum of the squares of the weights. L2 regularization helps drive outlier weights (those with high positive or low negative values) closer to 0 but not quite to 0. Features with values very close to 0 remain in the model but don’t influence the model’s prediction very much.1

L2 regularization always improves generalization in linear models.

See also

Footnotes

  1. developers.google.com/machine-learning/glossary#L2_regularization

2024 © ak